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ABSTRACT 

Procedures were developed and field tested for study of inde- 
pendent child behavior in the open classroom. Procedures involved 
observing and recording into mutually excil^^sive activity categories, 
the location of children and adults at two minute intervals over a 
thirty-six minute period. Incidents of inappropriate behavior were 
also recorded. Recording toojc place during a free-choice period. 
During the middle twelve minutes all adults, except the observer, 
left the classroom. 

Eight Head Start classrooms were used for field testing the 
system. Six of the classrooms used the Tucson Early Education Model 
(TEEM3 curriculum and two used local curricula for comparison. The 
procedure demonstrated sensitivity to changes in child behavior dur- 
ing tear^Tier absence. The variable demonstrating statistically signi- 
ficant changes was that of inappropriate behavior. Comparison class- 
rooms had significantly more incidents of inappropriate behavior dur- 
ing teacher absence than during teacher presence. TEEM classroom^ 
maintained a stable pattern of behavior throughout the observation 
period, 

The system was concluded to be extremely useful in assessment 
of independent learning behavior of children in large groups and - 
should transfer easily to other Qr^m classroom settings. 
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CHAPTER I 



INTRODUCTION 
Purpose 

The purpose of this study was to develop an observation instru- 
ment and technique for assessing independent child behavior in an open 
classroom. The study was limited to a description of the development 
of the system and to a field test of its sensitivity to shifts in behavior 
patterns of children when they were operating independently. 

Background 

The study was undertaken as part of a Head Start evaluation study 
by the Evaluation Component of the Follow ThroUgh program of the Arizona 
Center for Educational Research and Development. The Office of Child 
Development funded the Planned Variation Study of Head Start. This was a 
study patterned after the national Follow Through program, in which class- 
room curricula were deliberately varied throughout the country in order 
to evaluate differences in program effects. The Tucson Early Education 
Model (TEEM) , sponsored by the Arizona Center, was one of eight curriculum 
models selected for inclusion in the Planned Variation Study. 

Stanford Research Institute in Menlo Park, California, has held 
major responsibility for evaluation efforts o£ Follow Through projrtts 
throughout the country and of the Head Start Planned Variation projects 
in which Follow Through curriculum models were used. However, the Office 
of Child Development also supported small studies specific to particular 
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curriculum sponsors which were conducted by the sponsors theniselves, 
This study, then, was part of the study specific to the TEEM, 
The four goals of the TEEM study were: 

1, To develop an observation-evaluation system to test selected 
process goals of the TEEM, 

2, To develop a unique set of tasks to assess children's develop- 
ment in Head Start classrooms using the TEEM, 

3, To field test this battery in a small study with six TEEM class- 
rooms and two locally implemented comparison classrooms, 

4, To perform statistical analyses of potential non-directional 
differences between these classrooms (Rentfrow, Duming, Conrad 
and Goldupp, 1972) . 

This study was directed to the first of these four evaluation 
goals, the development of an observational-evaluation system to test 
selected process goals of the TEEM. These TEEM goals are development of / 
language competence, an intellectual base, a motivational base, and 
societal arts and skills. The area of interest in this study was limited 
to the third goal, motivational base. That goal is defined as a col- 
lection of attitudes and behavioral characteristics related to productive 
social involvement. These irclude positive attitudes toward school and 
toward the learning process, an appreciation for learning and a willing- 
ness to persist at learning taskS;, and an expectation of success and a 
willingness to change (Ari2;ona Center for Early Childhood Education, 1971). 

For purposes of this study the motivational base was Operatioii- 
ally defined as the extent to which children ntinue school related 
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tasks in a socially acceptable manner, without pressure or presencs of 
controlling adults, 

The motivational base is integral to the whole open education 
movement. Walberg and Thomas (1972) make a concerted effort to more 
clearly define open education and state that ^'implicit in the approach 
is a view of the child, especially in the primary grades, as a sigfdfi- 
cant decision-r:iciker in determining the direction, scope, means and pace 
of his education (p. 198). 

After discussing and identifying themes consistent in the open 

education movement, they state in their conclusion: 

The concept, has been the subject of very little evaluation 
and research, aside from testimonials by proponents. Before 
it is expanded from the limited number of extant experimental 
settings :in this country, administrators, teachers and parents 
quite properly should know if it leads to more learning, to 
higher leivels of performance in reading, to greater self- 
esteem and self-determination, to the good life. We have 
developed some exploratory instruments that are indicative 
of presumably important aspects of open classroom processes^ 
Seeing if these processes are related to valued educational 
outcomes is an obvious next step for those who wish to evalu- 
. ate Open Education (JValberg and Thomas, 1972, p. 207). 

Maccoby and Zellner (1970), in their overview of Follow Through 
projects, discuss varying points of view regarding motivation and 
independence. Whil3 reinforcement theorists see development of inde- 
pendence as a stretching out of a reinforcement schedule, the open educa- 
tors believe that reinforcement should come from the materials the child 
is working with and from the pleasure that comes from success. Maccoby 
and Zellner go on to state: 

To our knowledge, evaluation procedures comparing the . . 
effectiveness of the various programs have not attempted to 
assess how self-sustained the children's learning actually 
is. It would be possible to watch to see what happens when 
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the teacher goes out of the classroom--whether the children 
find something to work on, or whether they sit passively or 
engage in horseplay. This has not yet been done in any 
systematic way (Maccoby S Zellner, 1970, p. 75). 

A review of the literature produced virtually nothing in terms 
of assessment of independent behavior in children. It appeared that 
most efforts in this direction have been limited to paper and pencil 
tests, questionnaires, or projective techniques. Examples of projective 
techniques for: this purpose may be found in studies by Battle and 
Rotter (1963), and Riedel and Milgram (1970). 

A major exception to this deficit is a series of studies by 
IVhite and Lippitt (1960). Their approach to evaluation of independent 
behavior takes quite another direction, Itfhite and Lippitt formed small, 
informal boys' clubs and arranged situations in which the leadership 
style was varied. They set up several Vtest situations." One of the 
situations involved removing the leader during meetings either by ar- 
ranging his late arrival or his" departure for brief periods during the 
meeting. The leadership styles involved were labeled ' 'democratic," 
"autocratic," and "laissez-faire." All clubs were subjected to at 
least the democratic and autocratic leaders, whose roles were care- 
fully defined by the investigators. 

Observers were present during all of the situation variations, 
and no attempt was made to conceal observers from the boys. White and 
Lippitt believed that they had ample evidence that the observers were 
completely or almost completely ignored by the boys. 

The observers made anecdotal records of everything said by the 
five boys in a club and wrote a running account of all significant occur- 
rences. Conversation recorded was later subjected to sentence by sentence 



content analysis and interpreted in terms of social implications. '*The 
analysis was in terms of cat'egories such as 'aggression in democr::c7, V 
'aggression in autocracy,', 'friendly,' 'work-minded, [I'/hite § 
Lippitt, i960]." Among results of analyses made, it was found that in 
the autocratic setting boys were more hostile and aggressive. They 
also demonstrated more dependence and less individuality. 

l/hile White and Lippitt's studies dealt with only small groups, 
they believed that experiments at this level could bring insights to 
advantages and disadvantages of democratic organization (White ^ Lippitt, 
1960) . 

A meajiis for similar assessment in terras of the whole classroom 
setting appears to be . called for today. While the open clai^sroom pro- 
ponent might espouse many of the same goals and use many of the same 
"controlling'* techniques as those used by the democratic leader of 
Wliite and Lippitt *s studies, the increase in; size of group and area 
would make the observation of such a setting difficult if an observer 
were called upon to observe and record everything. The difficulties 
of evaluation in the open classroom seem inherent in the setting described 
in the recent New r> week , article (1971), They informally describe the open 
classroom atmosphere "as much, like that in. a newspaper ^ city room, where 
conversations, ringing telephones and chattering typewriters produce a 
constant cacophany. The noises are a distraction only to those who are 
not used to them [p. 62]." This atmosphere is later in the article 
referred to as "controlled chaos," ^ 

Wiile the type of observation technique used by IVhite and Lippitt 
(1960) does not seem practical in the total classroom environment, some v 



sort of observation technique does seem appropriate . Observat j on , as 
described by Ifright C1960), is a method that allows the study of spon- 
taneous and ongoing child behHvior in the settings of eveiyday life. 
Such inethods clearly seem called for in the open- informal environment 
in which no single specifiable outcone can be described for every child. 

IVhite and Lippitt's test situation of leader absence also seems 
appropriate to the classroom setting. Grinanott (1970) wrote a position 
paper in which she presented a compelling case for use of situational 
tests (i.e. , a standardized natural situation to which children respond 
behaviorally). She quotes (p. 8) from tho Subcomraittco on Compensatory 
Education in which they resolved that "learning porfornance, attitudes, 
curiosity, etc., will not be thought of as characteristics which the 
child possesses Independently of the setting in which they are nani- 
fested." Among the advantage^ of test situations prosentod by Griranett 
are that they call for demonstration of the required response, diisinution 
of dependency on verbal behavior, and slnulatlon of reality contexts. 

The Classroom Attitude Observation Schedule (CAOS), developed 
for the present study, combines observation with situational evaluation. 
The schedule specifically directs itself to measuring the self-direction 
aad independence of the learner. The classroom situation in which CAOS 
is used is one that calls for independent behavior on the part of chil- 
dren in the classrooa In the face of on adult-free situation. 

Two major sources were referred to for information on develop- 
ment of appropriate observation teclinlquos: Hedley and Mittel's chapter 
on "Measuring Classroom Behavior by Systematic Observation" found in 
the Handbook of Research on Teaching (1963) , and Wright 's chapter on 



"Observational Child Study" found in the Handbook of Research ! :9T...oc1s in 
Child Developi TK- 'oUowing are some of the major criteria 

discussed in t»c sources. 

1. The observer should. only be asked to classify some kind of unit 
of behavior, rather than mal?e judgments based on many individual 
behaviors (Medley and mtzel, 1963, p. 250), 

2. The observer should record relevant aspects of classroom behavior 
as they occur (or within a negligible time limit after), with a 
rainimum of quantification intervening between the observation 
and the recording of it (Medley and Mitzol, 1963, p. 250). 

3. The behavior to be observed must be divided into observable 
lengths (Wright, 19S0, p. 73). 

4. Two approaches to contruction of items were suggested. 

a. A category system which determines a convenient unit of be- 
havior and constructs a finite set of categories into one 
and only one of which every unit observed can be classified. 
This record shows for each period of observation the total 
number of units of behavior which occurred and the number 
classifiable in each category (Medley and Mitzel, 1963, p. 298). 

b. A sign system which lists beforehand a number of specific 
acts or incidents of behavior which may or may not occur dur- 
ing an, observation period. The record will show which of 
those incidents occurred during a period of observation and, 
In some cases, how frequently each occurred (Medley and 
Mitzel, 1962, p. 298). 



CHAPTER II 

DEVELOPMENT AND METHODOLOGY OF TFIE 
CLASSROOM ATTITUDE OBSERVATION SCHEDULE (CAOS) 

pevelopment Background 
The Classroom Attitude Observation Schedule (CAOS) has been 
developed using both a category and a sign system. The basic framework 
and category scheme were taken from the Classroom Observation Procedure 
(COP) developed for national Head Start evaluation by Stanford Research 
Institute (SRI, 1971). Dr. Jane Stallings, developer of the SRI pro- 
cedure, granted permission to make use of their instruments and was con- 
sulted regarding the planned adaptation of the SRI procedure. SRI'.s 
procedure actually encompasses several individual procedures. The two 
major procedures are the Classroom Check List (CCL) or "snapshot," and 
the Five Minute Observation (FMO) . Generally, their system involves 
completing the CCL once, just prior to the FMO, The CCL consists of 
seventeen mutually exclusive categories into which all teacher and child 
activities may fall. A clockwise visual scan of the room is made by an 
observer. During the scan the observer records the appropriate location 
for every child and adult. This followed by the FMO, which is a sys- 
tem of recording human interaction. Both are completed four times each 
hour during the school day. The portion of this system borrowed for 
CAOS was tho "snapshot" category sot, and the recording njothod involving 
the clockwise visual scan. The CAOS includes one addition, "wandering," 
to the activity category system. The activity categories used in CAOS are 
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Snack, lunch 
Group time 

Story, singing, dancing, music 

Arithmetic, math, numbers 

Reading, alphabet, language development 

Social studies, geography 

Stience, natural world 

Games, puzzles 

Arts, crafts 

Sewing, cooking, pounding, sawing 

Blocks, trucks 

Dolls, dress up, playhouse 

Play 

^ Transitional activities 

Classroom management 
Out of room 
Observing, other 
Wandering 

The definitions of these categories are essentially the same 
for CAOS as they are for SRI 's system. They have, however, been some- 
what redefined to make them more program specific to the Tucson Early 
Education Model and to deal niore appropriately with pursuits of four 
and five year old children. Figure 1 demonstrates one such redefinition. 
For a complete set of definitions for CAOS, see Appendix A. 
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The sign system, combined with the above category system, is a 
set of inappropriate behaviors which are recorded only if they ax , ob- 
served. The inappropriate behaviors are: 

Hitting (h) 

Yelling (y) 

Interfering (If) 

Leaving room without permission (Ir) 
Throwing (th) 
Other C*) 

Most of the inappropriate behaviors were taken from the categories used 
by Grimmett, Underwood, and Brackney (1970) for an instrument developed 
at the Arizona Center, the Schedule for Incompatible Learning Behavior 
(SILB). The SILB researchers developed their categories in consultation 
with classroom teachers in order to arrive at behaviors that were com- 
monly acknowledged as disturbing. The first four listed above were taken 
directly from the SILB. CAOS added to this the categories of "throwing" 
and "other" in lieu of a SILB category called '•disturbing." If the CAOS 
observer sees a behavior that is clearly disruptive, he may record it and 
note the behavior at the bottom of the recording form for a firm decision 
about its use at a.later time. A category called "ignoring" from the 
SILB was also not used. Teacher direction, subject to ignoring behavior 
on the part of children, is not a concern of the open classroom environ- 
went, nor is it clear that such behavior is disruptive. 

Methodology of the CAOS 
The CAOS has been designed to detect pattern shifts in a class- 
room during the absence of a teacher and all other controlling adults. 
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In order to establish patterns, a period of twelve minutes is spent by 
the observer recording activities of adults and children (Phaso A) ; L.^. I v 
minutes recording activities of children during absence of adults (with 
the exception of the observer) (Phase B); twelve minutes again recording 
both adult and child activities, with adults reinstated in the room 
(Phase C) . The total observation period consists of thirty-six minutes, 
as illustrated in Figure 2: 

A B C 

12 min. 12 min.. 12 min. 

Adults present Adults absent Adults reinstated 

Figure 2. Phases of CAOS 

Once every two minutes a clockwise visual scan is made of the 
room by the observer. In the course of each scan the observer coun-s 
and records the location of children and adults in the appropriate row 
and column of the CAOS Recording Form (Figure 3) . 

The recording form consists of a row for each activity category 
listed in the first column. There are six major blank columns for re- 
cording Bach two minute scan for a twelve minute observation phase. A 
completed observation of thirty-^ix minutes will consist of three such 
pages. Each of the major columns has two parts. One, labeled ''N.I/* is 
for recording number of children or adults engaged in the activity. The 
other, labeled V'l. A." is used to record incidents of inappropriate 
behavior. 
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The observer will find a position in the room that fulfills two 
requirements. First, it must offer the best view of all activitios in 
the room, and, second, it must not obstruct movement of c-iilUren ar .x. 
access to materials. Unce this position is located, the observer does 
all recording from there, remaining stationary for the entire thirty six 
minute period. Every two minute scan in that room, then, begins and ends 
at the .&me pcSnt. If any attempt is made on the part of children to 
interact with observers, the observer is to simply say, "I can't talk 
now, I laire work to do." 

Numbers of children and adults observed during the scan are 
placeii in the appropriate cell, while retaining grouping patterns in the 
recording. Teachers and helpers are recorded in the appropriate activity 
with a T iDr teacher and H for helper. If inappropriate behavior is 
observed fecring the scan, it is also noted by its associated activity 
and during the appropriate two-minute scan. The inappropriate behaviors 
are simply coded: by the initials shown in the listing given earlier, with 
the number of cialdren beshaving inappropriately. For example, y-3 in 
the I. A. columniwould mean that three children were yelling. Two more 
scans are made during the; two-minute period to pick up incidents of in- 
appropraite behavior, oner at the end of a minute and again at the end 
of a minute and a, half. 

Actual recording by the observer is made in the form of numbers 
of children observed engaging in an activity. Since the same type of 
activity may tajl& place in several areas of the room, an individual cell 
may contain seveual numbers. Tiiis then will show for any two minute 
period h<s*f childkieR grouped themselves as well as how many were engaged 



in any type of activity. During phases A and C, the adult present phase-: 
adults are recorded as well. Figure 4 is a small segment of a rocordjn;- 
form in which sample entries have been made. 

The recording of a two minute observation scan demonstrated by 
Figure 4 gives the following information about the classroom. One child 
is working with a helper either at a math center or any\^here in the class 
room at a math or number game or related activity. A child is working 
with a teacher in a language related activity (possibly the teacher is 
taking dictation, or is listening to the child read). Three children are 
involved in one art or crafts activity and are working with a helper. 
Somewhere else in the classroom two children and two helpers are work- 
ing at the same arts or crafts activity. In another area three children 
are operating independently, but the three are engaged in the same kind 
of arts or crafts activity. There are several ways to view these entries 
for arts and crafts. One is that three small groups are engaged in arts 
and crafts, in three different locations in the classroom. Another is 
that eight children and three helpers are engaged in arts and crafts. 
Reading down the form to the next activity, three children' are working 
independently at some sort of sewing, cooking, pounding, or sawing activ- 
ity. One chJ Id is playing with blocks or trucks. Two children are play- 
ing but at no clearly specified activity. Combined with this activity 
entry, is an entry for inappropriate behavior. One of the two children 
playing is yelling in a disturbing manner, inappropriate to the activity. 
Next, one child is involved in some sort of management activity such as 
handing out materials, or sharpening his pencil. 
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Figure 4, Sample Cckling of Two Minute 
Scan from CAOS. 
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Summarizing the information recorded in this two minutes, one 
may see that there were nine groups functioning at one time. Taerc were 
seven activities involved. All adults in the'Classroom were sperding 
their tiirie interacting with children. There was one incident o£ xnappro- 
--'priate behavior during the two minutes. 

Observer Training and Reliability 

The CAOS developer (this investigator) trained one other resojirdi 
assistant in use of CAOS during a two-v/eek period prior to the field test. 
Kindergarten classrooms at Ochoa School, TEEM's demonstration school in 
Tucson, Arizona, were used for training. 

Training consisted of a review of categories and their defini- 
tions, then practice coding by both observers in the same classroom, with- 
out the manipulative phase. After practice coding, the two observers 
met outside to compare coding and isolate trouble spots, I'Jhen defini- 
tions were not clear, they were re-worked until both observers could 
agree on their meaning and observability. 

Finally, arrangements were made with the two kindergarten class- 
room teachers to duplicate the manipulative situation. When the two 
observers recorded together during two thirty-six minute observations, 
taken on two separate days and several days apart, the observers achieved 
reliability with average agreement of 82%, and a high of 91%. It was 
felt that this was high enough to permit comparability of observations 
made by the observers in separate observations. 

The method used for calculation of observer agreement was Scott's 
"pi" coefficient (Scott, 1955) . Directions for use of Scott's formulae 
were taken from Flanders (1966) manual for interaction analysis observers. 
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Flanders found this a useful method because it is unaffected by y--M fre- 
quencies in some categories and can be used with percentage datt.. .?recin-.r: 
cies are converted to percentages. Following is the basic formula: 

■„ . - V 
. X = 0 e 

100 - P 

e , 

Observed percentage (P^) was calculated by finding the percentage dif- ' 

ference between observers for each category, summing the differences, 

and subtracting the sum- from 100, Expected percentage (P ) tos calcu- 
■ ; , ■ ■; ■ - e ' ■ 

lated by finding average percentage in each category for the two observers 
squaring the average, dividing by 100, and summing. This sum equals 
P (Flanders, 1966). 



CHAPTER III 



RESEARCH DESIGN AND FINDINGS 
Samp le 

As in all phases of the research for the TEEM- specific Head 
Start evaluation, only one of the three communities using the program' 
for Head Start Planned Variation could be included in the sampio due to 
economic limitations. Lincoln, Nebraska, which was the community selects 
has eight Head Start classrooms, six using the TEEM and two locally im- 
plemented curricula (Rentfrow.Durning, Conrad and Goldupp, 1972) . 

The population of behavior sampled was that occurring during 
free choice time in all eight classrooms. This; is the time when chil- 
dren' choose their own activities from those available in the classroom 
(Rubow and Fillerup, 1970) . The decision to standardize procedures on 
free choice time stemmed from a combination of reasons: 

a) The behavioral setting needed to be consistent across all class- 
iroojns. Grimmett, Underwood, and Brackney (1970) found powerful 

evidence that the behavioral setting controls incidence of dis- 
ruptive behavior, and individual choice time was associated with 
lower rates of inappropriate behavior than large group time. 

b) The block of time during which children choose their own activi- 
ties was the longest in both TEEM and locally implemented Head 
Start classrooms. Otherwise it would be impossible to obtain 

observations during a single behavior setting for a full thirty- 
six minute period. 

19 
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c) Free choice time in the TBEM classroom carries the greatest 
overlap into the opon classroom concept* 

Observations took place the last week of Arpil, 1972, with one 
(thirty-sjx minute) observation period for each classroom Uuring that 
week. Two observer- (the investigator and the trained research assis- 
tant) observed in four classrooms each. 

Plan for Anal ysis 
As stated earlier, the purpose of the CAOS study was to dis- 
cover pattern shifts given the absence of classroom '^controlling'^ adults, 
Such shifts could take many forms. The variables described below are 
those that might demonstrate controls v/hich are largely adultrcentored 
versus controls internalized by the children or imposed by the phyr?ical 
or behavior setting. A meaningful pattern would be one in which the 
variable increases or decreases during teacher absence and returns to 
the level exhibited during Phase A, when teacher returns in Phase 
A stable pattern, then, would be one in which all three phases look 
much alike. Three principal questions wore being asked • 

1. Are there differences between observation phases on any of the 

summary variables? 
2i Is there a difference between'THIlM and Comparison classrooms? 
3.^ Is there interaction between classroom assignment and observa- 
tion phase? 

To analyze the data a two by three factorial design was used. One inde- 
pendent variable used was classroom assignment (Tnnf! and Comparison), 
The other independent variable was observation phase (Phases A, B, and 
C). Phases were treated as repeated measures on the same subjects. 
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This analysis was repeated using each of tho five summary vari alios 
as tho dependent variable ♦ 

The dependent sUinmary Variables were: 

1. , Mean group size 

2. Mean number of children engaged in an activity 

3, Inappropriate behavior 

4, Mean number of groups 

5* Mean number of activities 

Mean group size was calculated by dividing total number of chil- 
dren counted. in a twelve-minute phase by the number of groups counted 
in that phase. Mean number of children engaged in an activity at any 
one time during the twelve-minute phase was calculated by dividing the 
total number of children counted in a phase by the number of cells used 
in the phase. Inappropriate behavio r was simply a total count of inci- 
dents of inappropraite behavior observed during the twelve-minute phase, 
Mean number of groups was calculated by dividing number of groups counted 
in a phase by number of two-minute scans in the phase. (In all but 
two instances, there were six scans for every phase.) Mean number of 
activities was calculated by dividing number of activity cells used in 
a phase by number of two-minute scans in the phase. 

Another analysis used independent ratings of teachers. The 
Lincoln Head Start Director was asked to rate all of the teachers on 
level of implementation of the TEEM. The scale used was a Likert Form 
with 1 to 9 levels. The lowest teacher rated was a '*2*' and the two 
highest were Since these ratings were assigned independently of 

the variables examined for CAOS, one high-rated teacher was selected at 
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random from the two high rated teachers and was compared witli tiic low 
rated teacher on the variablo showing greatest variation on CAOu ::\ 
group data (in this case, the variable of inappropriate behavior) . 

For further examination of the data, activity categories were 
collapsed into five broad types of activities. 

Type I consists of "traditional" academic activities and 
includes arithmetic, language, social studies and science. 

Type 11 consists of cognitive learning activities for young 
children but not in the "traditional" sense. Included in this type 
are stories, games, puzzles, arts, crafts, cooking and building. 
Type III consists of play and role playing. 
Type IV consists of snacks (seldom used as there was deliberate 
attempt to avoid snack time during the observation period) and nsanage- 
ment. Management activities are generally those involved in managing 
the room. Examples might bfc. cleaning up, handing out materials, 
going a:fter supplies (unless observer knows the related activity), 
sharpening pencils, teacher and child talking (child not waiting). 
These activities apply to both children and adults. 

Type V consists of non-focused activities such as transitional 
activities, children out of the room, and wandering. 
These five activity types were used to examine the proportion of time 
spent by adults and children in each activitytjtpe during Phases A and 
C combined, (when both were in the room together). These data were 
examined withS Spearman Rho rank order correlation comparing the same 
high-rated classroom and low-rated classroom. 
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Findings 

Due to the exploratory nature of the research and tho sudi 
pie of classrooms, generous confidence liiidts were set for acceptance 
of statistically Mgnificant findings. The acceptable alpha leAM.was 
set at .10. It K^^s felt that this level would serve as sufficient 
indication that a variable should be e:^lored in future research. 

Table 1 shows the results of analysis of variance of each of the 
five summary variables. For each of the summary variables three sources 
of variance are reported. The first, s^oup, refers to variance attribu- 
table to classroom style. The second, phase , refers to variance due to 
differences among the three twelve-minute observation phases. The third 
variance, group x phase , refers to interaction of classroom style and 
observation phase. 

Analysis of the first summary variable, mean group size, indi^ 
cated that differences among phases were significant (p<.10). There 
was no significant difference between classroom styles. 

The most conspicuous differences appeared with the second sum- 
mary variable, inappropriate behavior. Analysis of this variable indi- 
cated that significant differences existed in both independent variables, 
group and phase, as well as the interaction between these variables 
(group: p<.10; phase: p<.001; group by phase: p^.05)..l Figure 5 
gives graphic demonstration of the group-by-phase interaction. 

Further analysis of this summary variable was conducted using 
the Newraan-Keuls post hoc test. Since cell sizes were unequal the 
harmonic mean of cell n*s was used as an estimate of n (Winer, 1962). 
To aid in discussion of the results of this analysis, following is a 
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Table 1 

Cdiiiparison of TEEM x Comparison Classrooms 
across Phases for Selected CAOS Observation 
Summary Variables 





Summary Variable 




Ui. 




r 


Mean Group Sixe 


Group 


1 


.0057 


.03 




Phase 


2 


.1700 


3.81* 




Group X Phase 


2 


.0380 


.85 


Inappropriate 


Group 


1 


193.3889 


20.80** 


Behavior 


Phase 


2 


139.8750 


14.36*** 




Group X Phase 


2 






Mean Activity 


Group 


1 


.2358 


.66 


Size 


Phase 


2 


.7926 


2.46 




Group X Phase 


2 


.2457 


.76 


Mean Number of 


Group 


1 


3.2939 


2.34 


' Groups 


Phase 


2 


.0870 


.06 




Group X Phase 


2 


1.2156 


.81 


Mean Number of 


Group 


1 


3.3153 


1.61 


Activities 


Phase 


2 


1.7060 


2.54 




Group X Phase 


2 


.4335 


.65 



*p<.10. 
**p<.05. 
***p<.001 
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Baseline Teacher Absent Rcinstiiution 



Observation phase 



^Figure 5. Incidents of ilnajapxopriate Learning Behavior: in^ TEEM 
ami Com|Earison Classrooms flcross: Oba«rvation Phases. 
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diagram of the analysis of variance design used for the summary vari- 
ables. Cell means for inappropriate behavior are represented by tuo. 
numbers in the diagram. 







Phase 






A 


B 


C 


TEEM 


1 


2 




Comparison 


4 


5 


6 



Fig, 6, Analysis of Variance Design. 

Alpha level for this test was set at ,05, Cell 5 (Teacher absent phase 
in Comparison classrooms) was significantly different from every other 
cell. No other significant differences were found. 

No significant F-ratios were obtained for the other three sum- 
mary variables tested, mean activity size, mean number of groups, and 
mean number of activities. 

With only one classroom in the high-rated category and one in 
the low-rated category, no tests were conducted for statistical signifi- 
cance of the inappropriate behavior variables. However, a chart was 
prepared parallel to that for the summary variable, and the interaction 
pattern ran an essentially similar course (Figure 7). 

When proportion of adult participation in each of the five 
activity types was compared to proportion of child participation in the 
same activity types during the same phases, rank order correlation be- 
tween adult participation and child participation in the low rated class- 
room was -.27 (Figure 8). In the high rated classroom, the correlation 
between adult and child participation was .80 (Figure 9). 
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Figure 7. Incidents of Inappropriate Learning Behavior in a High 
and a Low Rated Classroom across Observation Phases. 
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CHAPTER IV 



CONCLUSIONS AND DISCUSSION 
The Classroom Attitude Observation Schedule was developed for 
the purpose o£ assessing independent learning behavior of children in 
the open classroom setting. Tlie Schedule was field tested to determine 
its sensitivity to differences in behavior when children were given the 
opportunity to be self-directing, That opportunity consisted of a period 
of time when none of the adults who normally manage the classroom was 
present. 

Conclusions 

The CAOS system is clearly sensitive to pattern shifts in some 
aspects of child behavior* The clearest pattern shift appeared with 
levels of inappropriate behavior. Children in the two comparison class- 
rooms displayed more inappropriate behavior during the teacher absent 
phase than did the children in TEEM classrooms. The post hoc tests 
demonstrated no significant differences between level of inappropriate 
behavior in TEEM classrooms and Comparison classrooms during the teacher 
present phases. The differences between these two groups during teacher 
absent phase was significant (p<';65) .. 

Within the TEEM classrooms, children in the classroom rated 
lowest by the Head Start Director displayed more^Lnappropriate behavior 
during teacher absence than did children in the Mgh-rated classroom. 
It also held true that there were significant diSerences between 
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teacher absent -and teacher present phases in Comparison classroor/is, while 
there were no significant differences between phases in TEEM clr.'j'jvoous . 
These comparisons also appeared to exist betv/een the lovz-rated and the 
high- rated classroom. 

The system picked up other indications of shifting patterns 
during teacher absence. One which was statistically significant was the 
area of nean group size. The size of groups in which children clustered 
themselves changed significantly when the teaclier was not present. The 
difference demonstrated by this variable was significant when all 
eight classrooms were examined across phases. There were no significant 
differences between TEEM classrooms and Comparison classrooms on this 
variable, however. Analysis does not, of course, indicate direction 
of the change in group size, only that it grows larger or smaller v/hen 
the teacher is not controlling it. 

This conclusion should be approached with caution for several 
reasons. There is^ in the Lincoln Head Start comnmnity, a fair amount of 
communication between teachers in TEEii classrooms and Comparison class- 
rooms. Adaptations of the TEEf! prograra to needs of very young children 
will probably also cause the two classroom types to look more alike at 
this level than at levels for older children. In addition, the class- 
room rated lowest of the eight was a TEEM classroom, even when air eight 
were rated by the Head Start Director on the same criteria: 

The evidence is fairly conclusive that in some of these class- 
rooms, particularly the Comparison and the low rated TEEr! classroom, 
controls come largely from the teacher and not from controls internalized 
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by the children or that come from the activities themselves and the ex- 
tent to which children find them satisfying. 

In the room showing greatest difference in behavior patterns, 
adults appear to be controlling the socially appropriate behavior, group 
size, and activity choices. In an open classroom the choices and group- 
ing patterns belong much more properly in the purview of the child. 

While there are implications for further research into possible 
causes of the differences found with CAOS, one possible direction turned 
up serendipitously as a result oftheCAOvS data collection method. It 
was possible to compare the proportion of adult time spent in certain 
kinds of activities to the proportion of time children were spending in 
the same kinds of activities and at the same time. Figures 7 and 8 
demonstrate such comparisons in the high rated and low rated classrooms. 
In the low ratad classroom, correlation between adult md child partici- 
pation in activity types was -.27. The same comparison made in the high 
rated classroom reaches a correlation of .80. 

It appears th^^t a classroom in which the children are best able 
to maintain a stable pattern of operation, whether or not adults are 
present, is the classroom in which adults spend their time interacting 
with children when they are both present in the classroom. A classroom 
in which the children do not maintain a stable pattern during teacher 
absence is a room in which the adults spend a large proportion of their 
time (37%) in management activities rather than interacting with chil- 
dren. While the adult-child ratio in these two rooms is not different, 
the quality of adult-child interaction clearly is different. 
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Problems and Concerns 

Two concerns arose regarding possible recording errors at, an 
artifact o£ the data collection method. The first arose from the possi- 
bility of children being missed in a two minute scan. As noted earlier, 
by requiring that the observer remain stationary during the entire obser- 
vation period, it was possible to miss children who were obscured by 
block buildings, playhouse, and the like. It was felt at the outset . 
that this was the price necessary to got at the overriding issue, behav- 
ior of children when they believe they are alone. 

The second and related concern arose from the time required for 
a visual scan of the room. If a child moved quickly, it was entirely 
possible that he could be counted more than once in a scan. 

In order to check data loss or gain a simple check was made. For 
each classroom, the mean number of children observed during a scan was 
calculated for each phase. IVhen each classroom was plotted across phases, 
they essentially plotted straight, horizontal lines. There was one major 
exception. In one classroom, the mean number of children dropped by 
three during the teacher absent phase. The observer noted that children 
clustered so much at the doorway during the teacher's absence that it 
was difficult to count them. In the other seven classrooms, differences 
were so minor (amounting to less than 1 child in most cases)..,that the 
data were not considered seriously distorted by the recording conditions. 

Another matter of concern should be noted regarding the parti- 
cular data sample used for this study, On two occasions observation 
phases were cut short. On.one occasion, the teacher returned to the room 
four minutes before completion of phase B. In another observation the 



teacher called the children to the rug tliree minutes before tlic end of 
the final reinstitution phase* In alL cases, siunnary data were c^'lcu- 
lated with reduced nuiaber of semis for the abbreviated phases. 

Some concern was expressed by consultants to this project within 
the Arizona Center that the observer's presence in the classroom would 
exert the very control the experimenter was attempting to rcraove, licdley 
and Mitrel (1963) discuss this issue as a long-standing criticisu of 
observation systems by many researchers. They say that such criticism 
is akin to the boy who turned out the light and tried to get to bed 
before it got dark. Medley and Jlitsol (1963) believe that to gain in- 
formation about students and teachers under observation seems better 
than knowing nothing about how they behave. 

There was anecdotal evicenco to suggest that the observer did 
not exert uuuue control in this experiment. A child, no i^iore than three 
feet froid an observer, exclaimed v/hen the teacher and helpers left, *^0h 
boy, wo^re alone.** In another classroom when a piece of equipneiit nial- 
functionod during teacher absence, the observer was never even approached 
for assistance. Only other children were called upon. White and Lippitt 
(1900) reported the same sort of reaction (or lack of reaction) to ob- 
servers • Their observers were most often ignored, IH^en the loader loft 
the roow boys wore Ukoly to make remarks such as ^'Go ahead and do it; 
there isn't anybody here (p. 25]*'' 

It must be noted, however, that in two instances, observers in 
the CAOS study were aware of brief behavior controls exerted by their 
prosenco in the classroom/ In one instance, two boys started to vvrestle 
in the playhouse and the observer accidentally poxnittod eye cortA'^t; f»mi 
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the wrestling stopped immediately. In another instance, it appeared to 
the observer that one child was about to hurt another and the observer 
made eye contact and shook her head slightly, which also brought the 
behavior to a stop. All. that one can say is that there is no conclusive 
evidence to state that the observers did or did not exert undue control. 
Conclusions may still be drawn about the sensitivity of the observation 
procedure, since whatever control was exerted by the observer was in- 
deed exerted in every classroom. At the same time, it seems imperative 
that this issue be tested at some time in the future. A search should 
be made for open classrooins with two-way mirrors for totally invisible 
observation. Then the experiment should be run two ways, with the ob- 
server present in the room, and with the observer completely hidden, in 
order to assess the amount of control exerted by the observer's presence 
in the room. 

Implications for Future Resear ch 
Many questions need to be pursued in future research with larger 
samples. Many extensions of this research are foreseen. Vifhen consistent 
pattern shifts have been identified, indicating strong adult control as . 
opposed to more internalized control on the part of children, factors 
wlating to these patterns need to be sought. Evaluation designs are 
called for in which other classroom related variables will be correlated 
with the various patterns. 

One such study anticipated for the near future will look for 
correlation between elements relating to levels of TEEM implementation 
and patterns emerging through use of C AOS / It may then be possible to 
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discover which particular elements of the TEEM correlate with self- 
direction on the part of children in the classroom. 

Another aspect of future plans will involve searching for cor- 
relations between CAOS data and interaction data collected by Stanford 
Research Institute in the Five-Minute Observation portion of their Class- 
room Observation Procedure. 

It is then planned that all such information should be funnelled 
back to the classroom teacher to assist her in efforts to move children 
to self-direction. A part of this may also be development of specific 
instrumentation for use by the classroom teacher. 

r4uch of the research just mentioned is planned in at least four 
Follow Through sites during the year 1972-73. It is hoped that during 
this time, many of the. questions raised during the early phases of this 
study may be resolved. 



APPENDIX A 



CAOS ACTIVITY CATEGORY DEFINITIONS 

Snack; Lunch 

Refers to any and all eating (unless cooking or preparing food 
experience is part of a structured activity) . (If simple prepara- 
tion for a snack, code under classroom management .) 

1) Group Time 

Activities that require full group participatior^, such as morn- 
ing opening activities, planning for the day or for a party, 
sharing ideas or items, resting after lunch, or watching tele- 
vision for entertainment. (This activity is normally not ob- 
served with CAOS.) 

2) Story; Singing; Dancing; Music (any number of children) 

Any number of children listening to records. 
Helper or teacher reading story to children. 
Putting records away . 
Dancing. 

1) Arithmetic; Math; Numbers 

Any activities that involve numbers; counting devices; measur- 
ing activities, etc. This could include an 

abacus (even if child only appears to be idly moving beads 
across) 

measuring chart on wall 
number puzzles 
number blocks 

writing numbers on chalkboard 
working with sets 
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2) Reading; Alphabet; Language Development ' 

Any activity directed to the processes of teaching and Joarning 
language. This will include activities directed toward read- 
ing, writing or language development. Examples: 
teacher or helper taking dictation 

using typewriter (even if child only fiddling with Jceys) 
writing letters on chalkboard 
using language master 

any puzzles or games associated with letters or word games 
(if you are able to make that distinction, such as word 
or letter bingo) 

1) Social Studies; Geography 

Refers to the teaching and learning about people's life styles, 
culture patterns, and geography, An activity might be planning 
or responding to aspects of a field trip to the post office, a 
shopping center, a mueeum, etc. For geography, the children may 
be beginning mapping activities, charting the classroom, or map- 
ping the school or neighborhood. 

2) Science; Natural Study 

Refers to teaching and le^ining about plants, animals, minerals 

(care of, collection, con^jarieon) and science concepts. With 

very young children this isay consist of: 

playing with a classraom animal, such as a rabbit or gerbil 
looking at fish in a 

looking at objects thrmigh a microscope 
Included in the science concepts would be the intellectual skills 
taught through a variety of means. This would include "intellec- 
tual kits'V and activities; dealing with shapes which are used 
for fostering observatiicnial skills , making comparisons , and a 
variety of discrimination skills. 
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E. Games; Jjjzzles 

Guessiiig games, table games;;puz2les, including tinker toys, card 
games, and jig saw puzzles. 

F. 1) Arts; Crafts 

Any art activity such as painting, collage, drawing, coloring 
Cunless related to a language, math, or science activity), and 
crafts such as clay, stitchery, weaving, etc. If a child is draw 
ing pictures on the chalkboard, it will al.io be coded here. 
2) Sew; Cook; Pound; Saw 

Cutting of fabric as well as sewing will be coded here. Cooking 
activities that are clearly part of a learning activity as op- 
posed to a snack. Pounding and sawing will include any activi- 
ties at a woodworking bench. 

G. 1) Blocks; Trucks 

This will include both small and large blocks, 
2) Dolls,.; Dress Up; Playhouse 

Any aJdavity (other than snacks eaten in the playhouse), that 

invoBTes dolls, doll house, tea party,, dressing up, or oithex 

uses made of the playhouse area, such . as: barber shop or store. 

This scsfcegory would-also include play-iaith pijppets or any ^'^ 
ing QBt": situation. 

'Play 

Any play, mobile or quiet, that is not clearly part of another acti- 
vity but has the attention of the child and/ or is apparently being 
enjoyed by the child. Examples might be play with small cars or 
,, a toy garage. 



40 

If a child is playing with material that seems ver/ differenf: from 
its intended purpose, code here. Examples might be a sword fight 
with tinker toy sticks, rolling phonograph records, spinning abacus 
beads . 

Transitional Activities 

Waiting kinds of activities. Moving through from one situation to 
another. Waiting to talk to a teacher or aide; waiting in lino to 
get to an ongoing activity (such as the typewriter - unless involved 
with the child who is using the typewriter, such as advising or dic- 
tating) . Other kinds of transitional activities: goinij to the bath- 
room, getting a drink of water, tying shoes, putting on coats, chil- 
ren in conversation with another when they are not obviously as- 
sociated with another activity. (The last examples might be put in 
a category of a child's managing himself as opposed to managing the 
room.) 

Classroom Management 

Activities that involve; managing the room (as opposed to an ongoing 
activity or one's self) . If management kinds of actions take -place 
within the boundaries of an ongoing activity as part of that activity, 
they should be coded with the activity. However, if, for instaii(i^ 
cleaning of paint brushieffi or wsMng^ pots sand; pans takes paceasome 
distance from the art or cooking activity then it is coded"manage- 
ment". If the observer cannot make this distinction easily, then 
going on a principle of coding into the higher level, code into the 
activity. 



41 

K. Out of Room 

If children go out of the :iroom and you cannot see the activity thoy 
are engaged in or do not know in some other way, code them here. 
L. Observing; Other 

This category is for any child who cannot be coded into an activi% 
and seems only to be watchiBg others or looking out the window (wilft- 
out an activity from which ioe may have momentarily diverted his 
■attention) • 

The/*Other'* category is to fee used if you find it impossible to 
code the 'child in any otherrireasonable place - then make note of 
what he is doing at the i>ottioni of the code sheet . 
M • Wandering 

This category is a. mobile parallel to the "U' category. Code child 
kere if he appears to be wandering aimlessly, without having his 
attention focused on any activity or does not appear headed for s^^- 
specific place. If he appears to have purpose, but you don't know 
ntfhat it is, code into ''Claffixoom Management'^ 



Generally, if two activities seem to overlap, attempt to code the acti- 
vity that appears to dominate. If you are unable to do that, attempt 
to code for the first activity the child became engaged in. If all else 
fails, flip a coin. 
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